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PARTICLE DETECTOR 

RELATED APPLICATIONS 

This application claims priority to Australian Provisional Patent Application No. 
5 2003902319, filed 14 May 2003 and entitled "Laser Video Detector" and, the specification 
thereof is incorporated herein by reference in its entirety and for all purposes. 
FIELD OF INVENTION 

The present invention relates to an improved sensor apparatus and improved 
method of sensing. In particular the present invention relates to an improved particle 
1 0 detector and method of detecting particles. 

BACKGROUND OF THE INVENTION 

There are a number of ways of detecting smoke in a region, such as a room, 
building, enclosure, or open space. Some methods involve sampling air from the region 
and passing the sampled air through a detection chamber, whereby particles are detected 
15 and an estimation is made of the amount of smoke in the region of interest. Such an 
apparatus is exemplified in aspirated smoke detectors like LaserPLUS™ sold by the 
applicant. 

Other detectors are placed in the region of interest, and use a sensor to detect 
particles adjacent the sensor. An example of such a detector is a point detector, in which 
20 air passes between an emitter and a sensor, and the smoke is detected directly in the region 
of interest. 

In both cases if the smoke does not enter a sampling point (of the aspirated 
detector) or pass between the sensor and emitter of the point detector, no smoke will be 
detected. As many buildings employ air handling means for extracting air from a region, 
25 such as air-conditioning, there is no guarantee that smoke will be detected rather than pass 
out of the region via the air handling ducts. It can be very difficult to use the 
aforementioned methods of detecting smoke in outdoor areas or very large indoor arenas 
where there may not be appropriate locations to place a point detector or a sample point 
and connecting tubing. 
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Other devices used to detect smoke include the detector disclosed in US 3,924,252, 
(Duston) which uses a laser and a photodiode to detect light scattered from particles. This 
device uses a corner reflector to reflect the light back at the emitter. Duston requires a 
feedback circuit to detect whether the beam is emitted or blocked. 

Another type of detector is known as a "Beam Detector", which measures the 
attenuation of the intensity of a signal from a projected light source caused by smoke 
particles suspended in the projected light. These detectors have relatively low sensitivity 
and are only capable of measuring the total attenuation within the iUuminated region. 

Any discussion of documents, devices, acts or knowledge in this specification is 
included to explain the context of the invention. It should not be taken as an admission 
that any of the material forms a part of the prior art base or the common general knowledge 
in the relevant art in Australia or elsewhere on or before the priority date of the disclosure 
and claims herein. 

SUMMARY OF THE INVENTION 

In one form the present invention provides a method of detecting particles 
including emitting a beam of radiation into a monitored region and detecting a variation in 
images of the region indicating the presence of the particles. 

With respect to the above method, further steps embodying the method and features 
of preferred embodiments may include identifying an area of interest in the images which 
represents a corresponding zone of the monitored region. Scattered radiation within the 
zone may be represented in one or more segments of a corresponding image, which allows 
for the location of the particles in the region to be identified. The location of the particles 
may be determined in accordance with a geometric relationship between the locations of a 
source of emitted radiation, a direction of the emitted radiation and a point of image 
detection wherein, the geometric relationship is determined from the images. The detected 
variation may be an increase in scattered radiation intensity. The increase in scattered 
radiation intensity may be assessed with reference to a threshold value. The threshold 
value may be calculated by averaging integrated intensity values from the images. The 
method may comprise assigning different threshold values for different spatial positions 
within the region. The method may comprise directing the radiation along a path and 
identifying a target in the images, the target representing a position at which the radiation 
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is incident on an objective surface within the region. A location of the target in the images 
may be monitored and the emission of radiation may be ceased in response to a change in 
the location of the target. The method comprise identifying a location of an emitter in the 
images. Further, the method may comprise determining an operating condition of the 
5 emitter based on radiation intensity at the identified location of the emitter. The images 
may be processed as frames which are divided into sections which represent spatial 
positions within the monitored region. Also, the method may comprise monitoring 
intensity levels in associated sections of the images and assigning different threshold 
values for different spatial positions within the region which correspond to the associated 
10 sections. 

In another aspect, the present invention provides apparatus for monitoring a region, 
comprising: 

an emitter for directing a beam of radiation comprising at least one predetermined 
characteristic into the region; 

an image capture device for obtaining at least one image of the region; and 
a processor for analysing the at least one image to detect variation of the at least 
one characteristic between the images, indicating presence of particles within the region. 

The processor may be adapted to determine the location of particles in accordance 
with a geometric relationship between the locations of the emitter, the directed beam of 
radiation and the image capture device wherein, the geometric relationship is determined 
from the analysed images. The apparatus may comprise a plurality of emitters, arranged to 
direct radiation along different respective beam paths. The apparatus may further comprise 
one or more filters for adapting the image capture device to capture radiation from the 
emitter in preference to radiation from other sources. The filters may be one or more or a 
25 combination of: 

a temporal filter, 
a spatial filter, 
a band-pass filter, 
a polarising filter. 

The image capture device preferably comprises an attenuator. The attenuator may 
comprise a variable aperture device. A plurality of image-capturing devices may be used. 
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Preferably, the image capture device comprises a camera. It is also preferable that the 
emitter comprises a laser. 

In a further aspect, the resent invention provides a method of detecting particles 
comprising the steps of: determining a path of a beam of radiation comprising placing a 
5 first image capturing device to view a source of the radiation and at least a part of the path 
of the beam of radiation; communicating the position of the source to a processor; placing 
a second image capturing device to view an impact point of the beam of radiation; 
communicating related position information of the impact point to the processor; 
determining the path of the beam in accordance with a geometric relationship between the 
1 0 position of the source and the position information of the impact point. 

In yet another aspect the present invention provides a method of detecting particles 
comprising the steps of: deterniining a region of interest containing a path of a beam of 
radiation comprising locating a first point, being the position of a source of the beam, using 
an image capturing device; locating a second point being the intersection of the beam of 
15 radiation with a field of view of the image capturing device, determining the path of the 
beam in accordance with the first and second point; calculating a region of interest 
containing the determined beam path. 

The step of locating a second point may be performed with at least one 
substantially transparent probe and the probe is preferably removed from the beam path 
20 once located. 

In still another aspect, the present invention provides a method of determining the 
level of smoke at one or more subregions in a region of interest comprising: directing a 
beam of radiation within the region, selecting a view of at least a portion of a path of the 
beam with an image capture device, determining the location of the source of the radiation 

25 relative to the image capture device, determining the direction of the beam relative to the 
image capture device, dividing the beam of radiation into segments, deterniining a 
geometric relationship between the segments and the image capture device, adjusting a 
level of light received by the image capture device of each segment so as to allow for the 
geometric relationship. The segments may comprise at least one pixel and the segments 

30 are preferably grouped to form the subregions for smoke detection. 

In a further aspect the present invention provides apparatus adapted to detect 
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particles, said apparatus comprising processor means adapted to operate in accordance 
with a predetermined instruction set, said apparatus, in conjunction with said instruction 
set, being adapted to perform the method as disclosed herein. 

In embodiments of the present invention there is provided a computer program 
product comprising; a computer usable medium having computer readable program code 
and computer readable system code embodied on said medium for detecting particles 
within a data processing system, said computer program product comprising; computer 
readable code within said computer usable medium for performing the method steps the 
methods as described herein. 

Other aspects, advantages and features are disclosed in the specification and / or 
defined in the appended claims, forming a part of the description of the invention. 

Further scope of applicability of the present invention will become apparent from 
the detailed description given hereinafter. However, it should be understood that the 
detailed description and specific examples, while indicating preferred embodiments of the 
invention, are given by way of illustration only, since various changes and modifications 
within the spirit and scope of the invention will become apparent to those skilled in the art 
from this detailed description. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Further disclosure, improvements, advantages, features and aspects of the present 
application may be better understood by those skilled in the relevant art by reference to the 
following description of preferred embodiments taken in conjunction with the 
accompanying drawings, which are given by way of illustration only, and thus are not. 
limiting to the scope of the present invention, and in which: 

Figure 1 shows a schematic representation of an embodiment of a detector system 
25 from a side view; 

Figure 2 shows a top plan view of an embodiment of an image capture device and 
emitter position of the detector system of figurel; 

Figure 3 shows a schematic perspective representation of an image taken by an 
image capture device of figure 2; 

Figure 4 shows a system overview workflow for signal processing for the detector 
system of figure 1; 
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Figure 5 shows a graphical representation of segmentation of data captured by the 
image capture device in the embodiment of figure 1; 

Figure .6 shows a graphical representation of the integration of the data captured by 
the image capture device of the embodiment of figure 1; 

Figure 7a-c shows images illustrating background cancellation performed by the 
detection system of figure 1; 

Figure 8 shows a graphical representation of a method used for calculating pixel 
radius in an embodiment of the software used in conjunction with the operation of the 
detector system of figure 1; 

Figure 9 is a top plan schematic view of a second embodiment of a detector system 
in accordance with the present invention; 

Figure 10 is a top plan schematic view of a third embodiment of a detector system 
in accordance with the present invention; 

Figures 1 la-c are top plan schematic views of fourth, fifth and sixth embodiments 
15 of the detector system in accordance with the present invention; 

Figure 12 shows a schematic representation of a part of the detector system of 
figure 1; 

Figure 13 shows a schematic representation of captured image data from an image 
capture device of the detector system of figure 1; 
20 DETAILED DESCRIPTION 

In figure 1, an embodiment of a particle detector 10 is shown. The detector 10 is 
located in a region 12 to be monitored. The region could be a room, stadium, hallway, or 
other area. It is not necessary for the region to be enclosed or indoors. 

An image capture device 14 views at least a portion of the region 12, comprising a 
portion that contains electromagnetic radiation from emitter 16. The image capture device 
14 may be a camera or one or more devices forming a directionally sensitive 
electromagnetic receiver such as photodiodes or CCD's, for example. In the preferred 
embodiment, the image capture device 14 is a camera. In the present embodiment, the 
camera 14 uses full frame capture to capture the images to send analogue video 
information along communications link 1 8 to a processor 20. It is not necessary to use full 
frame capture. However, it is preferable to use full frame capture for engineering 
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simplicity in obtaining images, performance, and niinimising installation restrictions. As 
would be understood by the person skilled in the art, other image capture devices 14 such 
as line transfer cameras may be used and methods to compensate for the efficiency of full 
frame capture may be employed. Another communication link 22 connects the emitter 16 
to the processor 20. The processor 20 controls the output of emitter 16, and/or receives 
information about the output of emitter 16 through the communications link 22. 
Alternatively, the state of the emitter 16 may be sensed by the camera 14 or determined 
automatically as disclosed below. In the preferred embodiment, the emitter 16 is a laser 
producing visible, infra-red or other suitable radiation. The laserl6 may incorporate a lens 
21 and spatial filter such as a field of view restrictor 23. When a beam of light travels 
thought a homogeneous medium there is no scattering, only when irregularities are present 
does the beam scatter. Therefore, in the presence of particles such as smoke particles the 
laser beam will scatter. Furthermore, in accordance with the preferred embodiment, the 
laser 16 may be modulated, eg "laser on", laser "off' in a given sequence. When no smoke 
is present, the intensity of pixels in a captured image including the laser beam is the same 
regardless of the state of the laser. When smoke is present, there is a difference between 
the intensity of a captured image when the laser 16 is on (due to scattering), compared to 
the intensity when the laser 16 is turned off. 

Optional filters are shown in figure 1 in the form of a polarizing filter 24 and a 
band pass filter 26. The polarising filter 24 is adapted to allow electromagnetic radiation 
emitted from the emitter 16 to pass through, while preventing some of the background light 
from entering the camera 14. This is useful if the emitter 16 is a laser emitting polarised 
light, then the polarising filter 24 can be aligned with the polarisation angle of the laser 
beam to allow maximum transmission of laser light, while removing some background 
light, which typically is from randomly or non polarised light sources. The second filter 26 
is a band pass filter, which attempts to only allow light within a predetermined frequency 
range (i.e. the frequency of the electromagnetic radiation from the emitter 16). For 
example, an interference filter or coloured gel may be used as the band pass filter 26. By 
using a band pass filter (for example allowing substantially only light around 640 nm if a 
red laser of that frequency is used), significant background light will be removed, 
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increasing the relative intensity of light scattered from particles suspended in the air in the 
region 12. 

Other filtering methods comprise modulation of the laser and use of positional 
information with regard to the systems components as described below. 

The image capture device may employ an attenuator for controlling the radiation 
received. A controllable neutral density filter arrangement may be used. Alternatively, the 
attenuator could be in the form of controlling the intensity with a variable aperture. An' 
optional, adjustable, iris 24a can be used to control exposure levels. It can be manually set 
at the time of installation, or the system could automatically set the exposure according to 
incident fight levels. The reason for this is to niinimise or avoid camera saturation, at least 
in the parts of the field of view that are used in subsequent processing. The iris 24a could 
be a mechanical iris or an LCD iris or any other means to reduce the amount of light 
entering the camera. Some electronic cameras incorporate an electronic shutter, and in this 
case the shutter time can be used to control exposure instead of an iris 24a. A spatial filter 
24b is also shown, which may for example comprise a slit for effectively masking the 
incident light to the camera 14. For example, a slit may mask the incident received light at 
the camera 14 to conform generally to the shape of the laser beam as it would be projected 
in the plane of the camera 14 lens. Items 26, 24a, 24b & 24 can be physically located in a 
variety of orders or combinations. 

In use, electromagnetic radiation, such as a red laser light from emitter 16, passes 
through the region 12 and impacts on a wall or an absorber 28. The field of view of the 
camera 14 comprises at least part of the path of the laser, and optionally, the impact point 
of the laser on the wall, which in this case impacts on an absorber 28. Particles in the air in 
the region that intersect the laser, in this case represented by particle cloud 30, will cause 
laser light to scatter. Some of the light scattered from particles will fall on the sensor of 
the camera 14, and be detected. 

In the embodiment shown in figure 1 the camera 14 outputs analogue information 
to a video capture card 32 of the processor 20. The video capture card 32 converts the 
analogue information to digital information which is then further processed by computer 
34. The processing is undertaken by software 36 nmning on the computer 34, which will 
be described later. In the preferred embodiment, the processing is carried out in order to 
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inteipret the captured images) such that an image plane corresponds to or is mapped to 
corresponding positions on the laser beam. This may be achieved by relatively 
straightforward geometry and trigonometry once predetermined location or position 
information of the system's components is obtained. 

In other, embodiments it is possible to use a camera 14 which would capture the 
data and transmit it digitally to the processor 20 without the need for a video capture card 
32. Further, the camera 14, filters 24, 26, processor 20 and light source 16 could be 
integrated into a single unit or units. Also, embedded systems may be employed to provide 
the functions of at least the processor 20. 

A number of camera 14 configurations are able to be used in this application, 
provided image information in the form of data can be supplied to the processor 20. 

In the example shown in figure 1, a laser modulator 38 is used to vary the power of 
the emitter 16. The power level can be changed to suit lighting conditions, meet eye safety 
requirements and provide on/off modulation. In this embodiment, the camera 14 captures 
15 30 frames every second, the emitter 16 is cycled on for one frame and off for the next. The 
amount of light in a region is sensed for each frame, and the sum of the light in a region 
when the laser is off is subtracted from the sum of light received while the laser is on. The 
sums may be over several frames. The difference between the sum of light received when 
the laser is on compared to the light received when the laser is off is taken as a measure of 
20 the amount of scattering in that region. To act as an alarm, a threshold difference is set and 
should the difference be exceeded, the alarm may be activated. In this way the detector 10 
may act as a particle detector. As measuring the scattered light from particles is known to 
be a method of detennining whether there is smoke in a region, the detector 10 may be 
used as a smoke detector. More detail on the cancellation, filtering and software is 
25 provided below. 

The detector 10 may be set to wait until the measured scattering exceeds a given 
threshold for a predeterrnined period of time, before indicating an alarm or pre-alarm 
condition. The manner for determining an alarm or pre-alarm condition for the detector 10 
may be similar to the methods used in aspirated smoke detectors using a laser in a 
30 chamber, such as the VESDA™ LaserPLUS™ smoke detector sold by Vision Fire and 
Security Pty Ltd. 
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Figure 2 shows a top view of the embodiment in figure 1. The camera 14 has a 
field of view 6, which in this case covers substantially all the region 12, which may be a 
room in a building. The light from emitter 16 is directed generally towards the camera 14, 
but not directly at the lens. There is therefore an angle subtended by an imaginary line 
5 between the camera 14 and the emitter 16, and the direction of the laser beam. The angle 
may be in the horizontal plane as shown by angle z in figure 2, and/or the vertical plane as 
shown by angle x in figure 1. The laser beam does not impact on the camera lens directly. 
Nonetheless, the laser beam path will be in the field of view of the camera 14, as shown in 
figure 3. 

10 Physical System Variations 

It is desirable in some circumstances to use a number of emitters in a system. This 
may be to comply with regulations, provide back up, or to assist in covering a larger area 
than could be covered with a single emitter. 

If coverage of a large area is required, it is possible to employ a number of emitters 

15 so that smoke may be detected in a number of different locations within a region. Figure 9 
shows an arrangement whereby camera 50 is located within a region such a room 52. If 
detection was required across a large area, multiple lasers 54 and 55 could be spread 
around the room to provide coverage. Figure 9 shows the emitters grouped into two 
groups, with emitters from group 54 targeted at point 56 and emitters 55 targeted at point 

20 57. The camera 50 may have the points 56 and 57 in view, or may not see the points 56 
and 57. Camera 50 may have points 56 and 57 in view by way of an optical arrangement 
to project an image of points 56 and 57 into the field of view of camera 50, for example, 
rear view mirrors (not shown) placed forward of camera 50. Likewise a prism or some 
other optical system could achieve this result. Further, the emitters 54 and 55 may all be 

25 on simultaneously, or may be cycled, so that if the camera 50 can detect the point at which 
the radiation lands, the radiation detected in the camera can be used to verify that the 
emitter is operating and not blocked. Detection of individual emitters is possible if they 
were switched on and off sequentially, or in any sequence of patterns that are not linearly 
dependant, so that using timing information, it is possible to detect which emitter is on at 

30 any one time. Further, knowing which emitter was firing would allow the detector to 

localise sub regions in the area to be protected and ascertain where any detected particles 
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were located with respect to the sub regions. In effect the beam or beams that have been 
scattered by particles may be determined. 

The emitters 54 and 55 do not all need to intersect on targets 56 and 57, and may be 
distributed along a number of targets, or cross over each other onto other targets. 
5 An alternative is shown in figure 10, where the lasers 58 and 59 are aimed away 

from the camera 60. The camera 60 can detect a light from the laser light hitting the wall 
at point 61 and 62. If either of these points disappears, then the detector system knows that 
either a laser is faulty or something is blocking the path of the laser light. If the laser is 
blocked, generally the object blocking the laser light will also reflect the light, and 

10 therefore the laser spot will shift from the known target area, that is original point 61 or 62. 
The camera can detect the shift in the spot and may sound an alarm or turn the laser off. 
This may be important, especially if the laser is not considered eye safe. Another means 
by which faults may be detected is when a spurious object such as a spider web intersects 
with a beam causing scattering. Occasional movement of the emitted beam, for example 

1 5 by translating the emitter in a lateral direction, will obviate such false detections of 
scattered radiation. 

In figure 10 a second camera 63 is shown which may be connected to the system to 
provide additional views. Using two cameras may allow a more accurate means of 
locating the area of smoke than using a single camera. Also, the additional view will 
20 provide scattering information for different scattering angles for the same particulate 
material. This data can be used to discriminate between materials with different particle 
size distributions or scattering properties. This in turn can be used to reduce the system 
sensitivity to nuisance particles that might otherwise cause false alarms such as dust, for 
example. With the use of one or more emitters, variation in scattering angle; wavelength 
of emitted radiation; polarisation rotation; plane of polarisation of viewed scattering and 
varying the timing of emission and detection all provide means for discriminating between 
different types of particles. 

In figure 11a camera 64 views two lasers 65 and 66 that cross the room. Figure 
1 lb uses a laser that is reflected back towards the camera 67, to provide better room 
30 coverage and capture both forward and backward scattered light. 
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In the present embodiment, the processor 10 comprises a personal computer 
running a Pentium 4 chip, Windows 2000 operating system. 

An important aspect of the present embodiments is signal processing is discussed in 
detail below with reference to figure 4 which is a data flow diagram, the layout of which, 
would be understood by the person skilled in the art. For ease of reference, the signal 
processing in this embodiment is conducted using software for the detector 10, referred to 
as LVSD software. It is to be noted with reference to figure 4 that the data flow lines 
mdicate image data flow, array data flow and simple numeric or structured data flow at 
different stages of the processing. Thus, some of the processing functions described may 
handle the more intensive image data or optionally, the less intensive numeric data, for 
example. As would be understood by the person skilled in the art, engineering efficiencies 
may be attained by choice of the components and software entities used to carry out the ' 
processing functions at these respective stages. 

Laser State Determ ination 

At step 401 of figure 4 a determination of the laser state is performed. The LVSD 
software in this embodiment relies on having the laser source within the field of view of 
the camera in order to determine the state of the laser for a particular frame. 

A small region of interest is assigned that includes the laser source radiation The 
centre of the region is set to an initial position of the laser source spot. The average pixel 
value in the region is computed. It is then compared with a threshold value to make the 
decision of whether the image records the laser on or off. 

The threshold value is the average of the outputs of a peak detector and a trough 
detector that are fed by the average. Each detector executes an exponential decay back to 
the current average in the case that a new peak or trough has not been made. The time 
constant is set in terms of frames, preferably with values of about 10. 

This technique has proven to be fairly robust. An alternative method is to look for 
one or more pixels that exceeded the average in the rectangle by a fixed threshold. 

In an implementation where the laser on/off switching is more closely coupled to 
frame acquisition this function may not be required. However, it can still serve a double 
check that the laser source is not obscured and is of the correct intensity. 
Laser Position 
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At step 401 of figure 4, a centre of gravity algorithm estimates the pixel co- 
ordinates of the laser source within the area being monitored. This positional information 
is optionally updated at every "laser on" image to allow for drift in either the laser source 
or camera location due to movement of the mounts and/or building over time. The factors 
5 affecting the stability comprise movement of walls within the building, mounting point 
rigidity etc. 

More precisely, the threshold established in the previous step (laser state 
determination) is subtracted from the image and negatives are clipped to zero. The centre 
of gravity of the same rectangle used in the state determination then yields (x,y) co- 
1 0 ordinates of the laser spot. In this calculation, the pixel values are treated as weight. 

An alternative technique is to treat the previously described area as an image and 
calculate an average of a large number (-50) of known "emitter off state" images, then 
subtract the average from the latest image that is known to have been captured with the 
emitter on. The previously described centre of gravity algorithm is then applied to the 
1 5 image data to estimate the position of the spot. 

Compute Regions of Interest & Background Cancellation 

At step 403 of figure 4, regions of interest are calculated. At step 404 of figure 4, 
background cancellation is performed. A combination of interpolation and frame 
subtraction is used during background cancellation to reduce interfering temporally variant 

20 and invariant information from the image. The image is segmented into three regions of 
interest as shown in figure 5. The background is segmented into background regions 101 
and 103, and there is an integration region 102. These regions are updated periodically to 
reflect any detected changes in the laser source location. The choice of shape of the 
regions of interest reflects the uncertainty in the precise position in the image of the 

25 scattered radiation. In figure 5 the camera cannot see the point where the emitted radiation 
hits the wall, and therefore the exact path of the emitted radiation is unknown. This 
produces a region of interest 102 that expands as the distance from the emitter increases. 
A method of determining the path of the emitted radiation manually is to test the location 
of the emitted radiation by blocking the radiation temporarily and checking its position, 

30 then entering the data manually into the processor. Alternatively, one or more 
substantially transparent probes, which may be in the form of articles such as plates, may 
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be inserted into the beam. Some scattering will occur on entry and exit from the plate 
providing a reference point or points in the image from which the required integration area 
and background areas may be computed. In applications where the detector may be used 
for detecting particles in, for example, clean room or hazardous environments, the 
5 windows of such enclosures may act as the substantially transparent plates and, these 
therefore may establish the path of the beam without the need to intrude into the 
environments to install the detector system components. The purpose of a narrow 
integration area is to reduce the noise contributions from pixels that are not contributing a 
scattering signal and also to allow the background regions to be closer to the integration 
10 region thus allowing a better estimate of the correction factor that is used for correcting the 
illumination level in the laser off images. 

The integration region 102 contains the emitted radiation path, while the areas to 
each side, background region 101 and 103, are used during background cancellation. The 
regions are generally triangular, that is wider further away from the laser source. This is 
15 necessary because while the exact location of the radiation spot is known, the exact angle 
of the path is not, so a greater tolerance is needed at the other end of the path when the 
camera cannot see where the radiation terminates. There is more noise in a fatter section of 
integration region due to more pixels, fortunately, each pixel represents a shorter length of 
the path, so the larger number of samples per unit length allows more averaging. If the 
camera can see the radiation termination point, there would be less uncertainty of its 
position and the regions of interest would not need to diverge as much as shown in figure 



20 



5. 



Two background regions 101, 103 are chosen for interpolation of the brightness 
compensation factor for correcting temporal variations in background lighting on either 
25 side of the radiation path in the laser off images. For example, changes in lighting due to 
two different, independent temporally varying light sources on either side of the radiation 
path. This principle could be further extended to allow for variations along the path, not 
just to either side of the path by subdividing the three areas 101, 102, 103 into segments 
along the length of the radiation path and performing the calculations for each subdivision. 
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The background cancelling algorithm sums n "on frames" and m "off frames" - the 
sequence of these frames is arbitrary. Prior to the subtraction of the "emitter off' frames 
from the "emitter on" frames, the "emitter off" frames are scaled by a factor, / to 
compensate for variance in lumination levels of the images. This may be useful with 
artificial lighting, the intensity of which varies rapidly. The resultant image contains any 
differences between the n "emitter on" and m "emitter off' images. This is shown 
graphically in figure 6. 

The scaling factor /is determined by interpolation, using the ratios of background 
variation between the laser on and laser off frames. 



f - 2 
where: 



H is the average value of pixel intensity in a given background region in either a 
laser on or laser off frame as designated by the subscripts. 

If the processor is not fast enough to keep up with the full frame rate, there needs to 
15 be a scheme to allow a random selection of frames to be processed. Since n laser on and m 
laser off frames are used for the backgound cancellation, while waiting to accumulate this 
number of frames, any excess laser on or laser off frames can be discarded. 

Alternatively a lock step synchronisation technique could be used so that the 
computer was fed information about the state of the laser with respect to the captured 
image. In any case, a minimum of one on frame and one off frame is required for the 
technique to work. 

An alternative to the cancellation scheme described above is to simply subtract 
laser on and laser off frames. Many on frames and off frames can be summed or averaged 
or low pass filtered, with the summing, averaging or filtering performed before and/or after 
25 the subtraction. 

The result of the background cancellation is an image that is predominantly 
composed of scattered light from the emitter, and some residual background light and 
noise. 

Frame Integ ration 
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At step 405 of figure 4 frame integration is performed. A number of background 
cancelled frames are summed, averaged or otherwise low pass filtered to obtain a scattered 
light image with reduced noise. By averaging a number of frames, interference that is not 
correlated with the laser on / off switching is reduced and the wanted (correlated) 
scattering information is retained. Typically the total number of frames used in the 
background cancellation and frame integration steps is approximately 100 (i.e. 
approximately 3 seconds of video). Longer periods of integration or lower filter cut-off 
frequencies may yield an improved signal to noise ratio, and allow a higher sensitivity 
system at the expense of response time. 

With reference to figures 7a to 7c, the sequence of images shows the effect of 
background cancellation and integration in the detection of the scattered light. The image 
intensity has been scaled to allow for better visibility to the eye. The particle obscuration 
level over the entire beam was approximately 0.15% per metre as measured by a 
VESDA™ LaserPLUS™ detector, sold by the applicant. Figure 7a shows the raw video, 
15 figure 7b highlights the region of integration, and figure 7c the scattered fight in the 
presence of smoke after background cancellation and integration. 
Scatter vs radius computation 

At step 406 of figure 4 computation of the scatter as a function of the radius from 
the emitter is performed. Variations in intensity along the beam due to system geometry 
and scattering may be remedied using this method. A data array is calculated containing 
scattered light levels in the integration region versus radius, for example measured in 
pixels in the captured image, from the laser source. Since a radius arc covers a number of 
pixels inside the integration, the intensity of each pixel within a given radius interval is 
summed together. Figure 8 is a graphical representation of how the integration region is 
segmented by arcs centred with respect to the emitter. In figure 8, triangle 80 represents 
the expected integration area and the arcs represent different radii from the laser source. 
Each portion of the integration area lying between a pair of arcs has its pixels summed and 
the sum is entered into the scattered light data array. For pixels that are not clearly 
between two of the arcs, rounding or truncation of the calculated radius corresponding to 
30 such pixels can be used to resolve the ambiguity. 

Compute geometry 



20 



25 
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At step 408 of figure 4, the geometry of the system elements/components is 
determined. Each pixel as described above (or image point) corresponds to a specific 
geometric configuration with respect to a scattering volume and the general case of such an 
image point is shown in figure 12. At each such point or pixel, the following parameters 
can therefore be determined: 

• 0 - scattering angle. 

• r - the distance in meters from the laser source. 

• D- distance from camera to laser source. 
L - physical length viewed by one pixel at a.given point along the beam. 

A corrected intensity of pixels corresponding to a given radius, r, is then 
determined for a real world system, in which the intensity of pixels is multiplied by a 
predetermined scattering gain value, discussed below under Scattering Angle Correction, 
corresponding to the given radius and a given scattering angle relative to a lossless 
isotropic scattering calculation. A resultant scattered data array is formed. 
15 Scattering angle correction 

A correction for scatter angle is logically determined in accordance with step 409 
of figure 4. As an input, the program requires a scattering data file, which contains for a 
given material, the scattering angle and its corresponding gain. The data in this file is 
generated by an empirical calibration process, and is intended to contain average values for 
20 a variety of smoke types. 

At each scattering angle as determined during the above geometry computation, the 
gain for every scattering angle is derived. The data from the input scattering data file is 
linearly interpolated so that for every scattering angle an approximation of the forward 
gain can be calculated. 

25 Compute Smoke vs Radius 

A determination of smoke for a given radius of the beam is performed at step 407 
of figure 4. To convert the scattered data array to smoke levels on a per pixel basis 
requires input of data D, d and 6 U as shown in figure 12. Any combination of lengths or 
angles that constrain the geometry can also be used. D is the distance from the camera 82 

30 to the emitter 84, 0, is the angle made between the line from camera 82 and the emitter 84 
and the line corresponding to the path of the radiation from the emitter 84, and d is the 



WO 2004/102498 



PCT/AU2004/000637 



-18- 



length of the line perpendicular to the emitted radiation that intersects the camera entrance 
pupil. From this information, all other necessary information can be determined by 
trigonometry and geometry. The geometry can be seen in figure 12. 

For each element in the previously described Scatter vs Radius array, the values of 
5 L, 6 T and r, as shown in figure 12, are computed. L is the length of the beam that is visible 
to one camera pixel. 

Integrate alon g beam to obtain obscuration 

At step 410 of figure 4, integration over beam image sectors is performed to obtain 
the detected obscuration. The beam length is divided into a number of sectors to provide 
10 addressability along the beam. In order to distinguish between the laser source and 
scattering of the laser beam, the pixels around the laser spot location cannot be included as 
part of a sector, as the intensity caused by scattering cannot be resolved, especially for an 
uncollimated source for which flaring may occur causing residual intensity in the pixels 
surrounding the source. 

Likewise at the camera end, due to the geometry of the set up, the field of view of 
the camera allows the beam to be viewed to within a few meters of the camera. 

In order to provide a smooth transition between sector boundaries, a simple moving 
average filter is implemented. In fact, the beam is divided into n+1 segments, and then a 
moving average is applied (of length two segments) resulting in n sectors. 

Each pixel along the beam captured image corresponds to a physical length along 
the beam see figures 8 and 12. This physical length gets smaller as the beam approaches 
the camera. So starting at the laser end and ignoring the pixels that are outside the end 
boundaries, the obscuration for a particular sector is the sum of all the pixel intensities 
after the application of the correction noted above, which fall into the physical length and 
25 position as described by that sector. 

For example, to determine the obscuration, O, over the whole beam, given as a 
sector size in pixel radius, r, as n to m, 



15 



20 



o= 



ts{r)L{r) 



r<=n 



where S is scattered light andZ is given above. 
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As noted above, the beam length is divided into a number of segments to determine 
individual smoke levels for each segment effectively simulating a number of point 
detectors. The output of these notional point detectors can be provided to an addressable 
fire panel. This is based on the theory that scattered light emitted from each segment of 
the emitted radiation will provide a different light output for a given particle density based 
upon the angle from the radiation path to the camera and the number of pixels per segment. 
As the path of the emitted radiation comes closer to the camera that is as r increases in 
figure 12 the angle 0 r increases. The number of pixels that contain scattered light will also 
increase due to the apparent widening of the beam in the direction towards the camera 82. 
This increase in width is shown in figure 8 and figure 13. Figure 13 shows the emitted 
radiation from emitter 84. The angle of the radiation spread is amplified for clarity. As the 
emitted radiation travels further from the emitter (that is as r increases), the number of 
pixels that coincide with the location of potential scattered radiation increases. At the 
radius 86, close to the emitter, only two pixels are determined to be within the region of 
interest covered by the detector, and the light from these pixels is summed and placed into 
an array 90, being scattered_light(r), which comprises a n times 1 array of information, 
where n is the number of pixels across the screen. At radius 88, many more pixels are 
within the area of interest covered by the detector, and they are all summed to obtain the 
amount of scattering obtained within the covered region of interest. Calculated at array 92 
is the scattering radiation angle 0 n which will be different for each pixel. That is, when r is 
small, 6 r will be small, and as r increases, so does 0 r . This information is important, as 
particles of interest in detecting certain events can have different scattering characteristics. 
Very small particles (relative to the wavelength of the emitted radiation) scatter more 
uniformly regardless of 0 r (scattering angle), however larger particles scatter more in the 
forward direction, and reduce intensity as the angle d r increases. Quite often the particles 
of interest, in this example smoke particles, are relatively large particles and therefore it 
can be useful to employ a table of effective scaling factors of output of light for given 
scattering angles 0, Such tables are known in the use of smoke detectors using laser 
chambers to detect particles. 

Array 94 contains the actual radius of the light captured by the pixels. Array 96 
comprises the length of the segment of the emitted radiation encompassed by, in this case, 
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one horizontal pixel in the captured image in the frame of the camera. This information is 
used to ascertain the volume of the emitted radiation and is used to assist in the calculation 
of the radiation intensity. Also, array 96 contains data on the smoke intensity at each point 
r, defined as smoke [r]. 
5 Alarm state 

Finally with reference to figure 4, alarm states are calculated. The alarm states for 
each sector are determined based on thresholds and delays and a priority encoding scheme, 
as per standard aspirated smoke detectors, or other parameters determined by the user. 

The same method is used for the zone alarm level, except that final zone output is 
1 0 the highest sector or the zone level, whichever is higher. 
Fault detection 

The system may have provision for the detection of a fault condition, which is 
essentially the absence of the laser spot in the image. The laser on/off signal duty cycle 
may be checked to be within 33% to 66% over the number of frames used in one 
1 5 background cancellation cycle. 
Alternative E mbodiments 

A number of alternative embodiments are available, depending on application and 
desired features. Unless otherwise specified, the general principles of operation as 
described above apply to the implementation of the following variations. For example, 
20 fault detection may be carried out in a number of ways. 

In another application, the system described above could be used in applications 
where measurement of obscuration was important, such as airports where fog may cause 
planes to divert if visibility falls below a certain level. The system does not require 
ambient light to operate, and can therefore operate at night without additional hghting. An 
25 infrared camera could also be used with an infrared light source, where the light source, if 
of similar frequency to the detecting light, could be cycled so that the processor ignores' 
frames illuminated for security purposes. 

A typical security camera may take 25 images or frames per second. Smoke 
detection may only require detecting 1 frame per second or less. Therefore the remaining 
30 images can be used for security purposes. 
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To give increased sensitivity, video processing software operating within the 
detection sub-system (6,7) may be used to eliminate the contribution of nuisance changes 
in video signals which are not in the location known to be occupied by the light beam. 
Software based systems which perform a similar function of processing distinct areas of a 
5 video image are known, for example in video-based security systems such as Vision 
System's ADPRO™ products. 

The emitter may be a laser, emitting polarised radiation. The laser may emit visible 
radiation, infrared radiation or ultra violet radiation. Selection of the wavelength of the 
radiation may be dependent on the characteristics of the particles to be detected, as well as 

10 the characteristics of the apparatus and method to be employed in the detection of the 
particles. Other types of radiation emitter may comprise a xenon flash tube, other gas 
discharge tubes, or a laser diode or light emitting diode. The light is preferably collimated 
to at least some degree, but if the optional area segregation using regions of interest is 
employed, a broader radiation beam may be emitted. 

15 A further embodiment is shown in Figure 11c, which employs two cameras 1 02 

and 104, and a single laser 106. In this embodiment, one camera can view the emitter, and 
the other the position or target where the radiation hits the wall 108. In such a 
configuration, it is desirable if the cameras 102, 104 are connected to the same processor or 
at least communicate with each other. This system provides many advantages, such as 

20 confirmation that the radiation is not blocked, and can be used to determine more 

accurately a position of the emitter radiation with respect to camera 104, which detects the 
forward scatter of light. As such, the degree of uncertainty of the position of the path of 
the emitted radiation is reduced, and the regions of interest can be reduced in size, 
increasing the sensitivity of the detector system. Further, as it is known that large 

25 particles, commonly caused by fire, forward scatter more than smaller particles (often 
associated with dust), a determination of particle characteristics can be made. If there is 
significantly more forward scatter than back scatter for a particular segment of the emitted 
radiation path, then it may be interpreted that the particle density at that particular segment 
consists of a proportion of large particles. It may be useful to compare this to other 

30 segments or other times, in order to ascertain characteristics of the event that caused the 
particles to be present in the first place. 
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While this invention has been described in connection with specific embodiments 
thereof, it will be understood that it is capable of further modification(s). This application 
is intended to cover any variations uses or adaptations of the invention following in 
general, the principles of the invention and comprising such departures from the present 
5 disclosure as come within known or customary practice within the art to which the 

invention pertains and as may be applied to the essential features hereinbefore set forth. 

As the present invention may be embodied in several forms without departing from 
the spirit of the essential characteristics of the invention, it should be understood that the 
above described embodiments are not to limit the present invention unless otherwise 

10 specified, but rather should be construed broadly within the spirit and scope of the 
invention as defined in the appended claims. Various modifications and equivalent 
arrangements are intended to be included within the spirit and scope of the invention and 
appended claims. Therefore, the specific embodiments are to be understood to be 
illustrative of the many ways in which the principles of the present invention may be 

1 5 practiced. In the following claims, means-plus-function clauses are intended to cover 

structures as performing the defined function and not only structural equivalents, but also 
equivalent structures. For example, although a nail and a screw may not be structural 
equivalents in that a nail employs a cylindrical surface to secure wooden parts together, 
whereas a screw employs a helical surface to secure wooden parts together, in the 

20 environment of fastening wooden parts, a nail and a screw are equivalent structures. 

"Comprises/comprising" when used in this specification is taken to specify the 
presence of stated features, integers, steps or components but does not preclude the 
presence or addition of one or more other features, integers, steps, components or groups 
thereof. 



